Image sensing apparatus having a signal processing device that uses a signal imaged in a non-exposure state to process a signal in an exposure state

ABSTRACT

An apparatus has an image sensing device, and a signal processing device for performing a first image sensing operation for making the image sensing device perform an image sensing operation in an exposure state to obtain a sensed image signal, and a second image sensing operation for making the image sensing device perform an image sensing operation in a non-exposure state to obtain a sensed image signal, and processing the sensed image signal obtained by the first image sensing operation by the sensed image signal obtained by the second image sensing operation. The signal processing device determines in accordance with the image sensing time of the first image sensing operation whether or not the second image sensing operation is performed.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image sensing apparatus for sensinga still image and/or moving image.

2. Description of the Related Art

Conventionally, image sensing apparatuses such as electronic cameras andthe like, which record/play back still images and moving images sensedby a solid-state image sensing element such as a CCD or the like usingmemory cards having solid-state memory elements as recording media, havealready been commercially available.

In an electronic camera using such solid-state image sensing elementsuch as a CCD or the like, a dark noise correction process can be doneby computations using dark image data which is read out after chargeaccumulation in the same manner as in actual image sensing while theimage sensing element is not exposed, and actually sensed image datawhich is read out after charge accumulation while the image sensingelement is exposed.

With this process, sensed image data can be corrected for image qualitydeterioration such as pixel omission or the like caused by dark currentnoise produced by the image sensing element and small scratches uniqueto the image sensing element, thus obtaining a high-quality sensedimage.

Especially, since dark current noise increases with increasing chargeaccumulation time and temperature rise of the image sensing element, ifexposure for a long period of time (seconds) or at high temperature isdone, a great image quality improvement effect can be obtained, and thedark noise correction process is a function useful for the electroniccamera users.

In this manner, since dark current noise increases with increasingcharge accumulation time and temperature rise of the image sensingelement, dark image data is re-captured using the charge accumulationtime of the image sensing element in units of image sensing processes.

For this reason, when actual image sensing is done after dark image datais captured, the shutter release time lag becomes longer by the darkimage sensing time, thus missing a shutter chance.

On the other hand, when dark image data is captured after actual imagesensing, the image sensing interval between the first and second framesis prolonged by the dark image sensing time in the continuous shot mode.As a result, constant image sensing frame intervals cannot be set.

Furthermore, in either case, since the dark image capture process isrepeated upon each image sensing, the consumption power increasesaccordingly.

SUMMARY OF THE INVENTION

One aspect of the present invention is to provide an apparatus, whichcomprises an image sensing device, and a signal processing device forperforming a first image sensing operation for making the image sensingdevice perform an image sensing operation in an exposure state to obtaina sensed image signal, and a second image sensing operation for makingthe image sensing device perform an image sensing operation in anon-exposure state to obtain a sensed image signal, and processing thesensed image signal obtained by the first image sensing operation by thesensed image signal obtained by the second image sensing operation, thesignal processing device determining in accordance with an image sensingtime of the first image sensing operation whether or not the secondimage sensing operation is performed, whereby the apparatus can preventa shutter chance from being missed, can set constant image sensing frameintervals, and can achieve power savings.

Other features and advantages of the present invention will be apparentfrom the following description taken in conjunction with theaccompanying drawings, in which like reference characters designate thesame or similar parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the arrangement of an electroniccamera according to the first embodiment of the present invention;

FIG. 2 is a flow chart showing the image sensing operation processsequence of an image sensing apparatus 100;

FIG. 3 is a flow chart showing the image sensing operation processsequence of the image sensing apparatus 100 and continued from FIG. 2;

FIG. 4 is a flow chart showing the image sensing operation processsequence of the image sensing apparatus 100 and continued from FIGS. 2and 3;

FIG. 5 is a flow chart showing the distance measurement/photometryprocess sequence in step S116;

FIG. 6 is a flow chart showing the image sensing process sequence instep S129;

FIG. 7 is a flow chart showing the image sensing process sequence instep S129 and continued from FIG. 6;

FIG. 8 is a flow chart showing the dark capture process sequence insteps S122 and S134;

FIG. 9 is a timing chart showing the flow of image sensing operation inthe first embodiment;

FIG. 10 is a flow chart showing the image sensing operation processsequence of an image sensing apparatus 100 according to the secondembodiment of the present invention;

FIG. 11 is a flow chart showing the image sensing operation processsequence of the image sensing apparatus 100 and continued from FIG. 10;

FIG. 12 is a flow chart showing the image sensing operation processsequence of the image sensing apparatus 100 and continued from FIGS. 10and 11;

FIG. 13 is a flow chart showing the image sensing operation processsequence of the image sensing apparatus 100 and continued from FIGS. 10,11, and 12;

FIG. 14 is a block diagram showing the arrangement of an electroniccamera according to the third embodiment of the present invention;

FIG. 15 is a flow chart showing the image sensing operation processsequence of an image sensing apparatus 100;

FIG. 16 is a flow chart showing the image sensing operation processsequence of the image sensing apparatus 100 and continued from FIG. 15;

FIG. 17 is a timing chart showing the flow of the image sensingoperation of the third embodiment; and

FIGS. 18 and 19 show memory maps of a nonvolatile memory 56 as a storagemedium.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The preferred embodiments of an image sensing apparatus, imageprocessing control method, and storage medium according to the presentinvention will be described hereinafter. The image sensing apparatus ofthis embodiment is applied to an electronic camera.

First Embodiment

FIG. 1 is a block diagram showing the arrangement of an electroniccamera according to the first embodiment of the present invention.

Referring to FIG. 1, reference numeral 100 denotes an image sensingapparatus. Reference numeral 12 denotes a shutter having a stop functionof controlling the exposure amount on an image sensing element 14.Reference numeral 14 denotes an image sensing element for converting anoptical image into an electrical signal.

Light rays that have entered a photographing lens 310 in a lens unit 300are guided onto the image sensing element 14 via a stop 312, lens mounts306 and 106, a mirror 130, and the shutter 12 by a single-lens reflexsystem, and form an optical image on the image sensing element 14.

Reference numeral 16 denotes an A/D converter for converting an analogsignal output from the image sensing element 14 into a digital signal.Reference numeral 18 denotes a timing generation circuit for supplyingclock signals and control signals to the image sensing element 14, theA/D converter 16, and a D/A converter 26. The timing generation circuit18 is controlled by a memory control circuit 22 and system controlcircuit 50.

Reference numeral 20 denotes an image processing circuit for performinga predetermined pixel interpolation process and color conversion processfor data from the A/D converter 16 or the memory control circuit 22. Theimage processing circuit 20 can execute a TTL (through the lens) AF(auto-focus) process, AE (auto-exposure) process, and EF (flashpre-emission) process. In these processes, the image processing circuit20 makes predetermined computations using sensed image data as needed,and the system control circuit 50 controls an exposure (shutter)controller 40 and distance measurement circuit 42 on the basis of theobtained computation result. Also, the image processing circuit 20 makespredetermined computations using sensed image data, and executes a TTLAWB (auto white balance) process on the basis of the obtainedcomputation result.

Since this embodiment comprises the distance measurement circuit 42 anda photometry circuit 46 dedicated to those processes, the AF, AE, and EFprocesses may be done using the distance measurement circuit 42 andphotometry circuit 46 in place of those using the image processingcircuit 20.

Alternatively, the AF, AE, and EF processes may be done using thedistance measurement circuit 42 and photometry circuit 46 in addition tothose using the image processing circuit 20.

Reference numeral 22 denotes a memory control circuit which controls theA/D converter 16, the timing generation circuit 18, the image processingcircuit 20, an image display memory 24, the D/A converter 26, a memory30, and a compression/expansion circuit 32.

Data output from the A/D converter 16 is written in the image displaymemory 24 or memory 30 via the image processing circuit 20 and memorycontrol circuit 22 or directly via the memory control circuit 22.

Reference numeral 24 denotes an image display memory; and 26, a D/Aconverter. Reference numeral 28 denotes an image display unitcomprising, e.g., a TFT LCD or the like. Display image data written inthe image display memory 24 is displayed on the image display unit 28via the D/A converter 26. When sensed image data is displayed using theimage display unit 28 as needed, an electronic viewfinder function canbe implemented. The image display unit 28 can arbitrarily turn on/offits display in accordance with an instruction from the system controlcircuit 50. When the display is OFF, great power savings of the imagesensing apparatus 100 can be achieved.

Reference numeral 30 denotes a memory for storing sensed still or movingimages. The memory 30 has a sufficient memory size capable of storing apredetermined number of still images or a moving image for apredetermined period of time. Hence, even in a continuous shot mode orpanorama mode for continuously sensing a plurality of still images, alarge number of images can be written in the memory 30 at high speed.Also, the memory 30 can be used as a work area of the system controlcircuit 50.

Reference numeral 32 denotes a compression/expansion circuit forcompressing/expanding image data by the adaptive discrete cosinetransform (ADCT) or the like. The compression/expansion circuit 32 loadsan image stored in the memory 30, compresses or expands it, and writesthe compressed or expanded data in the memory 30. These data are storedin a recording medium together with information upon capturing imagedata, e.g., information such as the photographing date,continuous-shot/panorama image sensing mode, and the like.

Reference numeral 40 denotes a shutter control circuit for controllingthe shutter 12 on the basis of photometry information from thephotometry circuit 46 in cooperation with a stop control circuit 340that controls the stop 312. Reference numeral 42 denotes a distancemeasurement circuit used to execute the AF process. Light rays that haveentered the photographing lens 310 in the lens unit 300 are guided tothe distance measurement circuit 42 via the stop 312, the lens mounts306 and 106, the mirror 130, and a distance measurement sub-mirror (notshown) by the single-lens reflex system, thus measuring the focusingstate of an image formed as an optical image.

Reference numeral 46 denotes a photometry circuit used to execute the AEprocess. Light rays that have entered the photographing lens 310 in thelens unit 300 are guided to the photometry circuit 46 via the stop 312,the lens mounts 306 and 106, the mirror 130, and a photometry sub-mirror(not shown), thus measuring the exposure state of an image formed as anoptical image. The photometry circuit 46 also has an EF process functionin cooperation with an electronic flash 48. Reference numeral 48 denotesan electronic flash which has a function of projecting AF assist light,and a flash light control function.

Note that the system control circuit 50 can perform exposure control andAF control using a video TTL scheme for the exposure (shutter)controller 40, stop control circuit 340, and distance measurementcontrol circuit 342 on the basis of the computation result of image datasensed by the image sensing element 14 by the image processing circuit20.

Furthermore, AF control may be done using both the measurement result ofthe distance measurement circuit 42 and the computation result of imagedata sensed by the image sensing element 14 by the image processingcircuit 20. Moreover, exposure control may be done using both themeasurement result of the photometry circuit 46 and the computationresult of image data sensed by the image sensing element 14 by the imageprocessing circuit 20.

Reference numeral 50 denotes a system control circuit for controllingthe overall image sensing apparatus 100. The system control circuit 50incorporates a known CPU, and the like. Reference numeral 52 denotes amemory for storing constants, variables, programs, and the like requiredfor operating the system control circuit 50. Reference numeral 54denotes an indication unit which comprises a liquid crystal displaydevice, loudspeaker, and the like, and indicates the operation state,messages, and the like using characters, images, sound, and the like inaccordance with execution of programs in the system control circuit 50.The indication unit 54 is set at one or a plurality of easy-to-seepositions around the console of the image sensing apparatus 100. Theindication unit 54 is constructed by a combination of an LCD, LEDs,sound generation element, and the like. Some functions of the indicationunit 54 are set within an optical viewfinder 104.

Of the indication contents of the indication unit 54, those displayed onthe LCD or the like include a single/continuous shot indication, selftimer indication, compression ratio indication, recording pixel countindicating, recorded image count indication, remaining recordable imagecount indication, shutter speed indication, aperture value indication,exposure correction indication, flash indication, red-eye suppressionindication, macro image sensing indication, buzzer setup indication,remaining timepiece battery capacity indication, remaining batterycapacity indication, error indication, information indication usingnumerals of a plurality of digits, attachment/detachment indication ofrecording media 200 and 210, communication I/F operation indication,date/time indication, connection indication with an external computer,and the like.

Of the indication contents of the indication unit 54, those displayedwithin the optical viewfinder 104 include in-focus indication, imagesensing ready indication, camera shake alert indication, flash chargingindication, flash charging completion indication, shutter speedindication, aperture value indication, exposure correction indication,recording medium write access indication, and the like.

Furthermore, of the indication contents of the indication unit 54, thosedisplayed using the LEDs and the like include, e.g., in-focusindication, image sensing ready indication, camera shake alertindication, flash charging indication, flash charging completionindication, recording medium write access indication, macro imagesensing setup notification, secondary battery charging state indication,and the like.

Of the indication contents of the indication unit 54, those indicated bylamps and the like include, e.g., a self timer notification lamp, andthe like. The self timer notification lamp may be commonly used as AFassist light.

Reference numeral 56 denotes an electrically erasable/programmablenonvolatile memory which stores programs (to be described later) and thelike, and uses, e.g., an EEPROM or the like. Reference numerals 60, 62,64, 66, 68, and 70 denote operation units for inputting variousoperation instructions of a system control circuit 50. These operationunits are constructed by one or a plurality of combinations of a switch,a dial, a touch panel, a pointer using line of sight detection, a voicerecognition device, and the like. These operation units will beexplained in detail below.

Reference numeral 60 denotes a mode dial switch which can selectivelyset one of various function image sensing modes: an automatic imagesensing mode, programmed image sensing mode, shutter speed priorityimage sensing mode, aperture priority image sensing mode, manual imagesensing mode, focal depth priority (depth) image sensing mode, portraitimage sensing mode, landscape image sensing mode, macro image sensingmode, sport image sensing mode, night scene image sensing mode, panoramaimage sensing mode, and the like.

Reference numeral 62 denotes a shutter switch (SW1), which is turned onin the middle of operation of a shutter button (not shown), andinstructs start of the AF process, AE process, AWB process, EF process,and the like.

Reference numeral 64 denotes a shutter switch (SW2), which is turned onupon completion of operation of the shutter button (not shown). Theshutter switch (SW2) 64 instructs start of a series of processesincluding an exposure process for writing a signal read out from theimage sensing element 14 as image data in the memory 30 via the A/Dconverter 16 and memory control circuit 22, a development process usingcomputation results in the image processing circuit 20 and memorycontrol circuit 22, and a recording process for reading out image datafrom the memory 30, compressing the readout data by thecompression/expansion circuit 32, and writing the compressed image datain the recording medium-200 or 210.

Reference numeral 66 denotes a playback switch which instructs to startplayback operation for reading out an image sensed in a given imagesensing mode from the memory 30 or the recording medium 200 or 210, anddisplaying the readout image on the image display unit 28.

Reference numeral 68 denotes a single/continuous shot switch, which canset one of a single shot mode for sensing one frame of image upondepression of the shutter switch SW2, and then setting a standby state,and a continuous shot mode for successively sensing images while theshutter switch SW2 is held down.

Reference numeral 70 denotes a console including various buttons, touchpanel, and the like, which include a menu button, set button, macrobutton, multi-frame playback new page button, flash setup button, singleshot/continuous shot/self timer switch button, menu move + (plus)button, menu move − (minus) button, playback image move + (plus) button,playback image move − (minus) button, sensed image quality selectbutton, exposure correct button, date/time setup button, select/changebutton that can select and change various functions upon executing imagesensing and playback in, e.g., the panoramic mode, determine/executebutton which can determine and execute various functions upon executingimage sensing and playback in, e.g., the panoramic mode, image displayON/OFF switch for turning on/off the image display unit 28, quick reviewON/OFF setup switch for setting a quick review function of automaticallyplaying back sensed image data immediately after image sensing,compression mode switch for selecting a compression ratio of JPEGcompression, and selecting a CCDRAW mode for directly converting asignal output from the image sensing element into digital data, andrecording the digital data in a recording medium, playback mode switchfor setting various function modes such as a playback mode, multi-frameplayback/delete mode, PC connect mode, and the like, AF mode setupswitch which can set a one-shot AE mode for starting auto-focusing upondepression of the shutter switch SW1, and maintaining an in-focus stateonce it is attained, and a servo AF mode for continuously executingauto-focusing while the shutter switch SW1 is held down, and the like.

In place of the plus and minus buttons, a rotary dial switch may be usedto select numerical values and functions more smoothly.

Reference numeral 72 denotes a power switch which can selectively setpower-ON and power-OFF modes of the image sensing apparatus 100. Also,the power switch 72 can also selectively set power-ON and power-OFFmodes of various accessories such as the lens unit 300, externalelectronic flash, recording media 200 and 210, and the like, which areconnected to the image sensing apparatus 100.

Reference numeral 80 denotes a power supply control circuit which iscomprised of a battery detection circuit, a DC-DC converter, a switchcircuit for switching a block to be energized, and the like. The powersupply control circuit 80 detects the presence/absence, type, andremaining battery amount of a battery attached, controls the DC-DCconverter on the basis of such detection results and an instruction fromthe system control circuit 50, and supplies a required voltage to therespective units including the recording media for a required period oftime.

Reference numerals 82 and 84 denote connectors; and 86, a power supplyunit, which includes a primary battery such as an alkali battery,lithium battery, or the like, a secondary battery such as an NiCdbattery, NiMH battery, Li battery, or the like, an AC adapter, and thelike.

Reference numerals 90 and 94 denote interfaces with recording media suchas a memory card, hard disk, and the like; 92 and 96, connectors forconnecting recording media such as a memory card, hard disk, and thelike; and 98, a recording medium attachment/detachment detection circuitfor detecting whether or not the recording medium 200 or 210 is attachedto the connector 92 and/or the connector 96.

Note that this embodiment has two sets of interfaces and connectors thatreceive the recording media. However, one or an arbitrary number of setsof interfaces and connectors that receive the recording media may beequipped. As interfaces and connectors of different standards, thosecomplying with the standards of a PCMCIA card, CF (compact flash) card,and the like may be used.

Furthermore, when the interfaces 90 and 94, and connectors 92 and 96 usethose complying with the standards of a PCMCIA card, CF (compact flash)card, and the like, and various communication cards such as a LAN card,modem card, USB card, IEEE1394 card, P1284 card, SCSI card, PHS, and thelike are connected thereto, image data and associated managementinformation can be transferred between the image sensing apparatus andan external computer or its peripheral devices such as a printer and thelike.

Reference numeral 104 denotes an optical viewfinder which can guidelight rays that have entered the photographing lens 310 via the stop312, the lens mounts 306 and 106, and the mirror 130 and a mirror 132 bythe single-lens reflex system, and can form and display them as anoptical image. In this manner, without using the electronic viewfinderfunction implemented by the image display unit 28, image sensing can bedone using the optical viewfinder 104 alone. In the optical viewfinder104, some functions of the indication unit 54, e.g., an in-focusindication, camera shake alert indication, flash charging indication,shutter speed indication, aperture value indication, exposure correctionindication, and the like are provided.

Reference numeral 110 denotes a communication unit having variouscommunication functions such as RS232C, USB, IEEE1394, P1284, SCSI,modem, LAN, radio communication, and the like. Reference numeral 112denotes a connector or antenna, which serves as a connector when theimage sensing apparatus 100 is connected to another device using thecommunication unit 110, or serves as an antenna in case of radiocommunications.

Reference numeral 120 denotes an interface for connecting the imagesensing apparatus 100 to the lens unit 300 in the lens mount 106; 122, aconnector for electrically connecting the image sensing apparatus 100 tothe lens unit 300; and, a lens attachment/detachment detector (notshown) for detecting whether or not the lens unit 300 is attached to thelens mount 106 and/or the connector 122.

The connector 122 also has a function of exchanging control signals,status signals, data signals, and the like between the image sensingapparatus 100 and lens unit 300, and supplying currents of variousvoltages. The connector-122 may communicate not only electrical signalsbut also optical signals, audio signals, and the like.

Reference numerals 130 and 132 denote mirrors which can guide light raysthat have entered the photographing lens 310 to the optical viewfinder104 by the single-lens reflex system. Note that the mirror 132 may beeither a quick return mirror or half mirror.

Reference numeral 200 denotes a recording medium such as a memory card,hard disk, or the like. The recording medium 200 comprises a recordingunit 202 comprised of a semiconductor memory, magnetic disk, or thelike, an interface 204 with the image sensing apparatus 100, and aconnector 206 for connecting the image sensing apparatus 100. Referencenumeral 210 denotes a recording medium such as a memory card, hard disk,or the like as in the recording medium 200. The recording medium 210comprises a recording unit 212 comprised of a semiconductor memory,magnetic disk, or the like, an interface 214 with the image sensingapparatus 100, and a connector 216 for connecting the image sensingapparatus 100.

Reference numeral 300 denotes an exchangeable lens type lens unit.Reference numeral 306 denotes a lens mount for mechanically coupling thelens unit 300 to the image sensing apparatus 100. The lens mount 306includes various functions of electrically connecting the lens unit 300and image sensing apparatus 100.

Reference numeral 310 denotes a photographing lens; and 312, a stop.Reference numeral 320 denotes an interface for connecting the lens unit300 to the image sensing apparatus 100 in the lens mount 306; and 322, aconnector for electrically connecting the lens unit 300 to the imagesensing apparatus 100.

The connector 322 also has a function of exchanging control signals,status signals, data signals, and the like between the image sensingapparatus 100 and lens unit 300, and receiving or supplying currents ofvarious voltages. Note that the connector 322 may communicate not onlyelectrical signals but also optical signals, audio signals, and thelike.

Reference numeral 340 denotes a stop control circuit for controlling thestop 312 on the basis of photometry information from the photometrycircuit 46 in cooperation with the shutter control circuit 40 thatcontrols the shutter 12. Reference numeral 342 denotes a distancemeasurement control circuit for controlling focusing of thephotographing lens 310; and 344, a zoom control circuit for controllingzooming of the photographing lens 310. Reference numeral 350 denotes alens system control circuit for controlling the overall lens unit 300.The lens system control circuit 350 has a memory function of storingconstants, variables, programs, and the like required for operating thelens unit 300, and a nonvolatile memory function of holdingidentification information such as a number or the like unique to thelens unit 300, management information, function information such as afull-aperture value, minimum aperture value, focal length, and the like,current and past setup values, and the like.

The operation of the electronic camera with the above arrangement willbe explained below. FIGS. 2, 3, and 4 are flow charts showing the imagesensing operation process sequence of the image sensing apparatus 100.This processing program is stored in a storage medium such as thenonvolatile memory 56, is loaded onto the memory 52, and is executed bythe CPU in the system control circuit 50.

Upon power ON after battery exchange or the like, the system controlcircuit 50 initializes flags, control variables, and the like and alsoperforms required predetermined initial setups in the respective unitsof the image sensing apparatus 100 (step S101). Furthermore, the systemcontrol circuit 50 resets a dark capture flag and continuous-shot startflag stored in its internal memory or the memory 52 (steps S102 andS103).

The system control circuit 50 checks the setup position of the powerswitch 72 to determine if the power switch 72 is set at the power-OFFposition (step S104). If the power switch 72 is set at the power-OFFposition, the system control circuit 50 executes a predetermined endprocess (step S105). More specifically, the system control circuit 50changes the indications of the respective indication units to an endstate, records required parameters and setup values including flags,control variables, and the like, and the currently selected mode in thenonvolatile memory 56, cuts off unnecessary power supply to therespective units of the image sensing apparatus 100 including the imagedisplay unit 28 by the power supply control circuit 80, and so forth.After that, the flow returns to step S102.

If the power switch 72 is set at the power-ON position, the systemcontrol circuit 50 checks using the power supply control circuit 80 ifthe remaining capacity and operation state of the power supply 86comprising batteries and the like pose any problem in the operation ofthe image sensing apparatus 100 (step S106). If any problem is found, apredetermined alert indication is made by means of an image or voiceusing the indication unit 54 (step S107), and the flow then returns tostep S102.

If no problem is found in the power supply 86, the system controlcircuit 50 checks the setup position of the mode dial switch 60 todetermine if the mode dial switch 60 is set at one of the image sensingmode positions (step S108). If the mode dial switch 60 is set at any ofother mode positions, the system control circuit 50 executes a processcorresponding to the selected mode (step S109), and the flow returns tostep S102 upon completion of the process.

On the other hand, if the mode dial switch 60 is set at one of the imagesensing mode positions, the system control circuit 50 checks if therecording medium 200 or 210 is attached, acquires management informationof image data recorded on the recording medium 200 or 210, and thenchecks if the operation state of the recording medium 200 or 210 posesany problem in the operation of the image sensing apparatus 100, inparticular, recording/playback of image data to/from the recordingmedium 200 or 210 (step S110). If any problem is found, a predeterminedalert indication is made by means of an image or voice using theindication unit 54 (step S107), and the flow then returns to step S102.

If no problem is found in step S110, the system control circuit 50checks the setup state of the single/continuous shot switch 68 that setsthe single/continuous shot mode (step S111). If the single shot mode isselected, the circuit 50 sets a single/continuous shot flag to indicatethe single shot mode (step S112); if the continuous shot mode isselected, the circuit 50 sets the single/continuous shot flag toindicate the continuous shot mode (step S113). With thesingle/continuous shot switch 68, the single shot mode for sensing oneframe of image upon depression of the shutter switch SW2, and thensetting a standby state, and the continuous shot mode for successivelysensing images while the shutter switch SW2 is held down can bearbitrarily selectively set. Note that the state of thesingle/continuous shot flag is stored in the internal memory of thesystem control circuit 50 or the memory 52.

The system control circuit 50 indicates various setup states of theimage display apparatus 100 by means of an image or voice using theindication unit 54 (step S114). When the image display of the imagedisplay unit 28 is ON, various setup states of the image displayapparatus 100 are indicated by means of an image also using the imagedisplay unit 28.

The system control circuit 50 checks if the shutter switch SW1 is ON(step S115). If the shutter switch SW1 is OFF, the flow returns to stepS102. On the other hand, if the shutter switch SW1 is ON, the systemcontrol circuit 50 executes a distance measurement/photometry process(step S116). More specifically, the system control circuit 50 executes adistance measurement process for bringing the photographing lens 310into focus on an object, and also executes a photometry process todetermine the aperture value and shutter speed. In the photometryprocess, the electronic flash is set if necessary. The distancemeasurement/photometry process will be described in detail later.

The system control circuit 50 determines the aperture value (Av value)and shutter speed (Tv value) on the basis of the stored photometry dataand/or setup parameters, and the image sensing mode selected by the modedial switch 60, determines a charge accumulation time Tn in accordancewith the determined shutter speed (Tv value), and stores the determinedvalues in its internal memory or the memory 52 (step S117).

The system control circuit 50 checks the state of the single/continuousshot flag stored in its internal memory or the memory 52 (step S118). Ifthe single shot mode is set, the flow jumps to step S125 to check thestate of the shutter switch SW2.

In this manner, if it is determined in step S118 that the single shotmode is selected, since the flow jumps to step S125 without executing adark capture process in step S122 (to be described later), the releasetime lag upon depression of the shutter switch SW2 in step S125 can bereduced.

On the other hand, if it is determined in step S118 that the continuousshot mode is selected, the system control circuit 50 checks the state ofthe continuous-shot start flag stored in its internal memory or thememory 52 (step S119). If the continuous-shot start flag is set, theflow then jumps to step S125.

In this manner, if it is determined in step S119 that thecontinuous-shot start flag is set, since the flow jumps to step S125without executing the dark capture process in step S122, the darkcapture process is done in step S134 as needed after the next frame ofimage is sensed in the process in step S129, once continuous shot imagesensing has started.

With this process, during continuous shot image sensing, priority isgiven to image sensing timing over the dark capture process, and theshutter release time lag can be reduced.

On the other hand, if it is determined in step S119 that thecontinuous-shot start flag is reset, the system control circuit 50checks the state of the dark capture flag stored in its internal memoryor the memory 52 (step S120). If the dark capture flag is reset, theflow jumps to step S122.

On the other hand, if it is determined in step S1120 that the darkcapture flag is set, the system control circuit 50 checks if the newcharge accumulation time Tn that was determined in step S117 and storedin its internal memory or the memory 52 is greater than the previouscharge accumulation time Tn−1 (step S121). If Tn≦Tn−1, the flow jumps tostep S125.

That is, if the newly determined charge accumulation time Tn is equal toor shorter than the previously used charge accumulation time Tn−1, sincea dark image correction process can be done using the already captureddark image data in a development process in step S136, another darkcapture process in step S122 is skipped.

On the other hand, if it is determined in step S121 that Tn>Tn−1, i.e.,if the newly determined charge accumulation time Tn is longer than thepreviously used charge accumulation time Tn−1, the dark capture processis redone using the new charge accumulation time Tn (step S122). In thedark capture process, the system control circuit 50 accumulates noisecomponents such as dark current and the like of the image sensingelement 14 for the same period of time as that required for actual imagesensing, while closing the shutter 12, and reads out the accumulatednoise image signal.

By making correction computations using dark image data captured by thedark capture process, sensed image data can be corrected for imagequality deterioration such as pixel omission or the like caused by darkcurrent noise produced by the image sensing element 14 and scratchesunique to the image sensing element 14. The dark capture process will bedescribed in detail later.

In this fashion, if the continuous shot mode is set in step S118,continuous shot image sensing has not started yet by pressing theshutter switch SW2, and no dark capture process is made after theshutter switch SW1 has been pressed, or if the dark capture process ismade after the shutter switch SW1 has been pressed, but it is determinedthat the image sensing condition has changed due to a change in chargeaccumulation time Tn, and the dark capture process is redone, the darkcapture process is executed prior to continuous shot image sensing, andnearly constant continuous shot frame intervals can be set, unless thedark capture process must be redone during continuous shot image sensingupon executing continuous shot image sensing by pressing the shutterswitch SW2 in step S125.

Upon completion of the dark capture process in step S122, the systemcontrol circuit 50 updates Tn−1 by replacing it by Tn (Tn−1=Tn) so as tostore the currently used charge accumulation time Tn as Tn−1 indicatingthe previously used charge accumulation time (step S123), and sets andstores the dark capture flag in its internal memory or the memory 52(step S124).

The system control circuit 50 checks if the shutter switch SW2 is ON(step S125). If the shutter switch SW2 is OFF, the system controlcircuit 50 checks if the shutter switch SW1 is ON (step S126). If theshutter switch SW1 is ON, the flow returns to step S116 to repeat aseries of processes. On the other hand, if the shutter switch SW1 isturned off in step S126, the flow returns to step S102.

On the other hand, if it is determined in step S125 that the shutterswitch SW2 is turned on, the system control circuit 50 checks if an areathat can store sensed image data is available on an image storage bufferarea on the memory 30 (step S127). If no area that can store sensedimage data is available on the image storage buffer area on the memory30, a predetermined alert indication is made by means of an image orvoice using the indication unit 54 (step S128), and the flow thenreturns to step S102.

For example, the user experiences such state immediately after he or shehas executed continuous shot image sensing corresponding to a maximumnumber of images that can be stored in the image storage buffer area. Inthis state, the first image to be read out from the memory 30 andwritten in the recording medium 200 or 210 is not recorded on therecording medium 200 or 210 yet, and a free area even for one imagecannot be assured on the image storage buffer area on the memory 30.

When sensed image data is stored in the image storage buffer area on thememory 30 after it is compressed, it is checked in step S127 if an areathat can store sensed image data is available on the image storagebuffer area on the memory 30, in consideration of the fact that thecompressed image data size varies depending on the setups of thecompression mode.

If an area that can store sensed image data is available on the imagestorage buffer area on the memory 30, the system control circuit 50executes an image sensing process (step S129). More specifically, thesystem control circuit 50 reads out a sensed image signal, which hasbeen accumulated for a predetermined period of time upon image sensing,from the image sensing element 14, and writes the sensed image data onthe predetermined area of the memory 30 via the A/D converter 16, imageprocessing circuit 20, and memory control circuit 22, or from the A/Dconverter directly via the memory control circuit 22. The image sensingprocess will be explained in detail later.

Upon completion of the image sensing process, the system control circuit50 checks the state of the single/continuous shot flag stored in itsinternal memory or the memory 52 (step S130). As a result of checkingthe state of the single/continuous shot flag, if the single shot mode isselected, the system control circuit 50 executes a dark capture process(step S134).

In this manner, if it is determined in step S130 that the single shotmode is selected, the system control circuit 50 executes the darkcapture process after the image sensing process, so as to reduce therelease time lag upon depression of the shutter switch SW2.

On the other hand, as a result of checking the state of thesingle/continuous shot flag in step S130, if the continuous shot mode isselected, the system control circuit 50 checks the state of thecontinuous-shot start flag stored in its internal memory or the memory52 (step S131).

If the continuous-shot start flag is reset, the system control circuit50 sets the continuous-shot start flag (step S132).

In this manner, if the continuous-shot start flag is reset, since darkimage data required for the development process in step S136 has alreadybeen captured in the dark capture process in step S122, the second frameof continuous shot image sensing is sensed without executing the darkcapture process in step S134 after the first frame is sensed in stepS129 upon starting continuous shot image sensing.

With this control, the continuous shot frame interval between the firstand second frames upon continuous shot image sensing can be shortened,and the shutter release time lag for the second frame can be reduced.

On the other hand, if it is determined in step S131 that thecontinuous-shot start flag is set, the system control circuit 50 checksif the new charge accumulation time Tn that was determined in step S117and stored in its internal memory or the memory 52 is greater than theprevious charge accumulation time Tn−1 (step S133). If Tn≦Tn−1, the flowjumps to step S136.

That is, if the newly determined charge accumulation time Tn is equal toor shorter than the previously used charge accumulation time Tn−1, sincea dark image correction process can be done using the already captureddark image data in a development process in step S136, another darkcapture process in step S134 is skipped.

In this manner, if the continuous shot mode is set in step S130, and thesecond and subsequent frames of continuous shot image sensing are sensedwhile the shutter switch SW2 is held ON, the shutter release time lagfor the second and subsequent frames can be reduced unless the darkcapture process must be redone. On the other hand, if it is determinedin step S133 that Tn>Tn−1, i.e., if the newly determined chargeaccumulation time Tn is longer than the previously used chargeaccumulation time Tn−1, a new charge accumulation time Tn is set to redothe dark capture process in step S134.

That is, if the continuous shot mode is set in step S130, and the secondand subsequent frames of continuous shot image sensing are sensed whilethe shutter switch SW2 is held ON, the dark capture process is done instep S134 only when the dark capture process has already been done butmust be redone since it is determined that the image sensing conditionhas changed due to a change in charge accumulation time Tn.

In this way, when a constant exposure value of an object is maintainedduring continuous shot image sensing, the dark capture process need notbe redone during continuous shot image sensing, and nearly constantcontinuous shot frame intervals can be set.

In step S134, the system control circuit 50 executes the dark captureprocess for accumulating noise components such as dark current and thelike of the image sensing element 14 for the same period of time as thatrequired for actual image sensing, while closing the shutter 12, andreading out the accumulated noise image signal.

By making correction computations using dark image data captured by thedark capture process, sensed image data can be corrected for imagequality deterioration such as pixel omission or the like caused by darkcurrent noise produced by the image sensing element 14 and scratchesunique to the image sensing element 14. The dark capture process will bedescribed in detail later.

Upon completion of the dark capture process, the system control circuit50 updates Tn−1 by replacing it by Tn (Tn−1=Tn) so as to store thecurrently used charge accumulation time Tn as Tn−1 indicating thepreviously used charge accumulation time (step S135).

The system control circuit 50 reads out some of image data written inthe predetermined area of the memory 30 via the memory control circuit22, executes a WB (white balance) integral computation process and OB(optical black) integral computation process required to executedevelopment processes, and stores the computation results in itsinternal memory or the memory 52.

The system control circuit 50 then reads out sensed image data writtenin the predetermined area of the memory 30 using the memory controlcircuit 22 and the image processing circuit 20 as needed, and executesvarious development processes including AWB (auto white balance)process, gamma conversion, color conversion, and the like using thecomputation results stored in its internal memory or the memory 52 (stepS136).

In the development processes in step S136, the system control circuit 50also executes a dark correction computation process for canceling darkcurrent noise and the like of the image sensing element 14 by executinga subtraction process using the dark image data captured in the darkcapture process.

The system control circuit 50 reads out image data written in thepredetermined area of the memory 30, makes the compression/expansioncircuit 32 execute an image compression process in accordance with theselected mode, and writes the image data that has sensed and undergone aseries of processes in a free image space of the image storage bufferarea on the memory 30 (step S137).

Upon executing a series of processes, the system control circuit 50starts a recording process for reading out image data stored in theimage storage buffer area of the memory 30, and writing the readoutimage data in the recording medium 200 or 210 such as a memory card,compact flash card, or the like (step S138).

This recording process is started for new image data, which has beensensed and undergone a series of processes, every time that image datais written in a free image space of the image storage buffer area on thememory 30.

While a write of image data in the recording medium 200 or 210 isunderway, a recording medium write access indication (e.g., flashing anLED of the indication unit 54) is made to clearly indicate that writeaccess.

The system control circuit 50 then checks if the shutter switch SW1 isON (step S139). If the shutter switch SW1 stays OFF, the flow returns tostep S102. If the shutter switch SW1 is ON, the system control circuit50 checks the state of the single/continuous shot flag stored in itsinternal memory or the memory 52 (step S140), and if the single shotmode is selected, the flow returns to step S139 to repeat the currentprocess until the shutter switch SW1 is turned off.

If the continuous shot mode is selected, the flow returns to step S116to proceed with image sensing, thus repeating a series of processes.

FIG. 5 is a flow chart showing the distance measurement/photometryprocess in step S116. In the distance measurement/photometry process,the system control circuit 50 and the stop control circuit 340 ordistance measurement control circuit 342 exchange various signals viathe interface 120, connectors 122 and 322, interface 320, and lenscontrol circuit 350.

The system control circuit 50 starts an AF (auto-focus) process usingthe image sensing element 14, and distance measurement circuits 42 and342 (step S201).

The system control circuit 50 executes AF control for checking thefocusing state of an image formed as an optical image by guiding lightrays, which have entered the photographing lens 310, to the distancemeasurement circuit 42 via the stop 312, lens mounts 306 and 106, mirror130, and distance measurement sub-mirror (not shown), and detecting thefocusing state using the distance measurement circuit 42 while drivingthe photographing lens 310 using the distance measurement controlcircuit 342, until the distance measurement (AF) result indicates anin-focus (steps S202 and S203).

If the distance measurement (AF) result indicates an in-focus, thesystem control circuit 50 determines an in-focus distance measurementpoint from those in an image sensing screen, and stores distancemeasurement data and/or setup parameters in its internal memory or thememory 52 together with the determined distance measurement point data(step S204).

Subsequently, the system control circuit 50 starts an AE (auto-exposure)process using the photometry circuit 46 (step S205). The system controlcircuit 50 executes a photometry process using the exposure (shutter)controller 40 for measuring the exposure state of an image formed as anoptical image by guiding light rays, which have entered thephotographing lens 310, to the photometry circuit 46 via the stop 312,lens mounts 306 and 106, mirrors 130 and 132, and photometry lens (notshown), until it is determined that the exposure (AE) value isappropriate (steps S206 and S207).

If it is determined in step S207 that the exposure (AE) value isappropriate, the system control circuit 50 stores photometry data and/orsetup parameters in its internal memory or the memory 52 (step S207A).

Note that the system control circuit 50 determines the aperture value(Av value) and shutter speed (Tv value) in accordance with the exposure(AE) result detected by the photometry process in step S206 and theimage sensing mode selected by the mode dial switch 60.

The system control circuit 50 determines the charge accumulation time ofthe image sensing element 14 in accordance with the determined shutterspeed (Tv value), and executes the image sensing process and darkcapture process using an equal charge accumulation time.

The system control circuit 50 checks in accordance with the photometrydata obtained in the photometry process in step S206 if the electronicflash need be operated (step S208). If the electronic flash need beoperated, a flash flag is set and the electronic flash 48 is charged toits full capacity (steps S209 and S210). When the electronic flash 48 iscompletely charged, the process returns to the main routine.

FIGS. 6 and 7 are flow charts showing the image sensing process sequencein step S129. In this image sensing process, the system control circuit50 and the stop control circuit 340 or distance measurement controlcircuit 342 exchange various signals via the interface 120, connectors122 and 322, interface 320, and lens system control circuit 350.

The system control circuit 50 moves the mirror 130 to a mirror upposition using a mirror driving unit (not shown) (step S301), and drivesthe stop 312 to a predetermined aperture value by the stop controlcircuit 340 in accordance with photometry data stored in its internalmemory or the memory 52 (step S302).

The system control circuit 50 clears charge on the image sensing element14 (step S303), then starts charge accumulation of the image sensingelement 14 (step S304), opens the shutter 12 by the shutter controlcircuit 40 (step S305), and starts exposure of the image sensing element14 (step S306).

The system control circuit 50 checks based on the flash flag if theelectronic flash 48 is required (step S307), and if the electronic flash48 is required, the circuit 50 controls the electronic flash 48 to emitlight (step S308).

The system control circuit 50 waits for the end of exposure of the imagesensing element 14 in accordance with the photometry data (step S309)Upon completion of exposure, the system control circuit 50 closes theshutter 12 by the shutter control circuit 40 (step S310), and endsexposure of the image sensing element 14.

The system control circuit 50 drives the stop 312 to a full-openaperture value by the stop control circuit 340 (step S311), and movesthe mirror 130 to a mirror down position by the mirror driving unit (notshown) (step S312).

The system control circuit 50 checks if the determined chargeaccumulation time has elapsed (step S313). If the determined chargeaccumulation time has elapsed, the system control circuit 50 ends chargeaccumulation of the image sensing element 14 (step S314), then reads outa charge signal from the image sensing element 14, and writes sensedimage data in a predetermined area of the memory 30 via the A/Dconverter 16, image processing circuit 20, and memory control circuit22, or from the A/D converter 16 directly via the memory control circuit22 (step S315). Upon completion of a series of processes, this processends, and the flow returns to the main routine.

FIG. 8 is a flow chart showing the dark capture process in steps S122and S134. After the system control circuit 50 clears charge on the imagesensing element 14 (step S401), it starts charge accumulation of theimage sensing element 14 while the shutter 12 is closed (step S402).

The system control circuit 50 checks if a predetermined chargeaccumulation time has elapsed (step S403). If the charge accumulationtime has elapsed, the system control circuit 50 ends charge accumulationof the image sensing element 14 (step S404), then reads out a chargesignal from the image sensing element 14, and writes image data (darkimage data) in a predetermined area of the memory 30 via the A/Dconverter 16, image processing circuit 20, and memory control circuit22, or from the A/D converter 16 directly via the memory control circuit22 (step S405). After that, the process ends, and the flow returns tothe main routine.

By executing the development process using this dark capture data,sensed image data can be corrected for image quality deterioration suchas pixel omission or the like caused by dark current noise produced bythe image sensing element 14 and scratches unique to the image sensingelement 14.

Note that this dark image data is held on the predetermined area of thememory 30 until a new distance measurement/photometry process is done orthe power switch of the image sensing apparatus 100 is turned off. Thisdark image data is used when the image sensing process is done later,and image data sensed by that process is read out to execute thedevelopment process. Or when image data sensed by the image sensingprocess and read out from the image sensing element 14 has already beenwritten in the memory 30, the development process is executed using darkimage data.

FIG. 9 is a timing chart showing the flow of image sensing operation inthis embodiment. As has been explained in detail above with reference toFIGS. 2 to 8, in the single shot mode, the AF and AE operations arerepeated upon depression of the shutter switch SW1, until the shutterswitch SW2 is turned on. Upon depression of the shutter switch SW2, thedark capture process is done after image sensing.

On the other hand, in the continuous shot mode, after the AF and AEoperation and the dark capture process are done upon depression of theshutter switch SW1, the AF and AE operations are repeated until theshutter switch SW2 is turned on. At this time, if it is determined thatthe image sensing condition has changed due to a change in chargeaccumulation time Tn determined in correspondence with the shutter speed(Tv value), the dark capture process is redone. Upon depression of theshutter switch SW2, the image sensing process and AF and AE operationsare continuously executed while the shutter switch SW2 is held ON.During these processes, if it is determined that the image sensingcondition has changed due to a change in charge accumulation time Tndetermined in correspondence with the shutter speed (Tv value), the darkcapture process is redone.

Second Embodiment

Although an electronic camera of the second embodiment has the samehardware arrangement as that of the first embodiment, some steps of theimage sensing operation process shown in FIGS. 2, 3, and 4 aredifferent. The different image sensing operation process will beexplained below.

FIGS. 10, 11, 12, and 13 are flow charts showing the image sensingoperation process sequence of the image sensing apparatus 100 in thesecond embodiment. This processing program is stored in a storage mediumsuch as the nonvolatile memory 56, is loaded onto the memory 52, and isexecuted by the CPU in the system control circuit 50, as in the firstembodiment.

Upon power ON after battery exchange or the like, the system controlcircuit 50 initializes flags, control variables, and the like and alsoperforms required predetermined initial setups in the respective unitsof the image sensing apparatus 100 (step S501). Furthermore, the systemcontrol circuit 50 resets a dark capture flag and continuous-shot startflag stored in its internal memory or the memory 52 (steps S502 andS503).

The system control circuit 50 checks the setup position of the powerswitch 72 to determine if the power switch 72 is set at the power-OFFposition (step S504). If the power switch 72 is set at the power-OFFposition, the system control circuit 50 executes a predetermined endprocess (step S505). More specifically, the system control circuit 50changes the indications of the respective indication units to an endstate, records required parameters and setup values including flags,control variables, and the like, and the currently selected mode in thenonvolatile memory 56, cuts off unnecessary power supply to therespective units of the image sensing apparatus 100 including the imagedisplay unit 28 by the power supply control circuit 80, and so forth.After that, the flow returns to step S502.

If the power switch 72 is set at the power-ON position, the systemcontrol circuit 50 checks using the power supply control circuit 80 ifthe remaining capacity and operation state of the power supply 86comprising batteries and the like pose any problem in the operation ofthe image sensing apparatus 100 (step S506). If any problem is found, apredetermined alert indication is made by means of an image or voiceusing the indication unit 54 (step S507), and the flow then returns tostep S502.

If it is determined that no problem is found in the power supply 86, thesystem control circuit 50 checks the setup position of the mode dialswitch 60 to determine if the mode dial switch 60 is set at one of theimage sensing mode positions (step S508). If the mode dial switch 60 isset at any of other mode positions, the system control circuit 50executes a process corresponding to the selected mode (step S509), andthe flow returns to step S502 upon completion of the process.

On the other hand, if the mode dial switch 60 is set at one of the imagesensing mode positions, the system control circuit 50 checks if therecording medium 200 or 210 is attached, acquires management informationof image data recorded on the recording medium 200 or 210, and thenchecks if the operation state of the recording medium 200 or 210 posesany problem in the operation of the image sensing apparatus 100, inparticular, recording/playback of image data to/from the recordingmedium 200 or 210 (step S510). If any problem is found, a predeterminedalert indication is made by means of an image or voice using theindication unit 54 (step S507), and the flow then returns to step S502.

If no problem is found in step S510, the system control circuit 50checks the setup state of the single/continuous shot switch 68 that setsthe single/continuous shot mode (step S511). If the single shot mode isselected, the circuit 50 sets a single/continuous shot flag to indicatethe single shot mode (step S512); if the continuous shot mode isselected, the circuit 50 sets the single/continuous shot flag toindicate the continuous shot mode (step S513). With thesingle/continuous shot switch 68, the single shot mode for sensing oneframe of image upon depression of the shutter switch SW2, and thensetting a standby state, and the continuous shot mode for successivelysensing images while the shutter switch SW2 is held down can bearbitrarily selectively set. Note that the state of thesingle/continuous shot flag is stored in the internal memory of thesystem control circuit 50 or the memory 52.

The system control circuit 50 indicates various setup states of theimage display apparatus 100 by means of an image or voice using theindication unit 54 (step S514). When the image display of the imagedisplay unit 28 is ON, various setup states of the image displayapparatus 100 are indicated by means of an image also using the imagedisplay unit 28.

The system control circuit 50 checks if the shutter switch SW1 is ON(step S515). If the shutter switch SW1 is OFF, the flow returns to stepS502. On the other hand, if the shutter switch SW1 is ON, the systemcontrol circuit 50 executes a distance measurement/photometry process(step S516). More specifically, the system control circuit 50 executes adistance measurement process for bringing the photographing lens 310into focus on an object, and also executes a photometry process todetermine the aperture value and shutter speed. In the photometryprocess, the electronic flash is set if necessary. The distancemeasurement/photometry process is the same as that in the firstembodiment.

The system control circuit 50 determines the aperture value (Av value)and shutter speed (Tv value) on the basis of the stored photometry dataand/or setup parameters, and the image sensing mode selected by the modedial switch 60, determines a charge accumulation time Tn in accordancewith the determined shutter speed (Tv value), and stores the determinedvalues in its internal memory or the memory 52 (step S517).

The system control circuit 50 checks if the new charge accumulation timeTn that was determined in step S517 and stored in its internal memory orthe memory 52 is greater than a predetermined charge accumulation timeTc (step S518). If Tn>Tc, the flow jumps to step S520; if Tn≦Tc, Tn=Tcis set (step S519), and the flow advances to step S520.

In this manner, if the newly determined charge accumulation time Tn isequal to or shorter than the predetermined charge accumulation time Tc,the newly determined charge accumulation time Tn is replaced by thepredetermined charge accumulation time Tc to execute a dark captureprocess using the predetermined charge accumulation time Tc.

With this control, if the new charge accumulation time falls within arange below the predetermined charge accumulation time Tc, the darkcapture process need not be redone by frequently changing the chargeaccumulation time in correspondence with a change in exposure conditionof an object. As a result, the shutter release time lag can be reduced,and nearly constant continuous shot frame intervals can be set uponcontinuous shot image sensing.

Since the dark capture process need not be frequently redone, electricpower can be prevented from being wasted.

Note that the predetermined charge accumulation time Tc preferably uses,e.g., a charge accumulation time, which is used in image sensing and thedark capture process at a shutter speed faster than 1/60 sec. In thiscase, the predetermined charge accumulation time Tc assumes anappropriate value beyond 17 msec, e.g., 20 msec, 30 msec, or the like.The predetermined charge accumulation time may be another arbitraryvalue, or may have not one value but a plurality of values in givenincrements, and appropriate one of these values may be selected incorrespondence with the operation mode or image sensing mode of theimage sensing apparatus 100.

On the other hand, if the newly determined charge accumulation time Tnis longer than the predetermined charge accumulation time Tc, the newlydetermined charge accumulation time Tn is inhibited from being replacedby the predetermined charge accumulation time Tc. With this control,when a change in exposure state (change in image sensing condition) ofan object beyond the predetermined charge accumulation time Tc has takenplace, the dark capture process can be redone using the newly determinedcharge accumulation time.

Subsequently, the system control circuit 50 checks the state of thesingle/continuous shot flag stored in its internal memory or the memory52 (step S520). If the single shot mode is set, the flow jumps to stepS527 to check the state of the shutter switch SW2.

In this manner, if it is determined in step S520 that the single shotmode is selected, since the flow jumps to step S527 without executing adark capture process in step S524 (to be described later), the releasetime lag upon depression of the shutter switch SW2 in step S527 can bereduced.

On the other hand, if it is determined in step S520 that the continuousshot mode is selected, the system control circuit 50 checks the state ofthe continuous-shot start flag stored in its internal memory or thememory 52 (step S521). If the continuous-shot start flag is set, theflow then jumps to step S527.

In this manner, if it is determined in step S521 that thecontinuous-shot start flag is set, since the flow jumps to step S527without executing the dark capture process in step S524, the darkcapture process is done as needed after the next frame of image issensed in the process in step S531, once continuous shot image sensinghas started.

With this process, during continuous shot image sensing, priority isgiven to image sensing timing over the dark capture process, and theshutter release time lag can be reduced.

On the other hand, if it is determined in step S521 that thecontinuous-shot start flag is reset, the system control circuit 50checks the state of the dark capture flag stored in its internal memoryor the memory 52 (step S522). If the dark capture flag is reset, theflow jumps to step S524.

On the other hand, if it is determined in step S522 that the darkcapture flag is set, the system control circuit 50 checks if the newcharge accumulation time Tn that was determined in step S517 and storedin its internal memory or the memory 52 is greater than the previouscharge accumulation time Tn−1 (step S523). If Tn≦Tn−1, the flow jumps tostep S527.

That is, if the newly determined charge accumulation time Tn is equal toor shorter than the previously used charge accumulation time Tn−1, sincea dark image correction process can be done using the already captureddark image data in a development process in step S538, another darkcapture process in step S524 is skipped.

On the other hand, if it is determined in step S523 that Tn>Tn−1, i.e.,if the newly determined charge accumulation time Tn is longer than thepreviously used charge accumulation time Tn−1, the dark capture processis redone using the new charge accumulation time Tn (step S524). In thedark capture process, the system control circuit 50 accumulates noisecomponents such as dark current and the like of the image sensingelement 14 for the same period of time as that required for actual imagesensing, while closing the shutter 12, and reads out the accumulatednoise image signal.

By making correction computations using dark image data captured by thedark capture process, sensed image data can be corrected for imagequality deterioration such as pixel omission or the like caused by darkcurrent noise produced by the image sensing element 14 and scratchesunique to the image sensing element 14. The dark capture process is thesame as that in the first embodiment.

In this fashion, if the continuous shot mode is set in step S520,continuous shot image sensing has not started yet by pressing theshutter switch SW2, and no dark capture process is made after theshutter switch SW1 has been pressed, or if the dark capture process ismade after the shutter switch SW1 has been pressed, but it is determinedthat the image sensing condition has changed due to a change in chargeaccumulation time Tn, and the dark capture process is redone, the darkcapture process is executed prior to continuous shot image sensing, andnearly constant continuous shot frame intervals can be set, unless thedark capture process must be redone during continuous shot image sensingupon executing continuous shot image sensing by pressing the shutterswitch SW2 in step S527.

Upon completion of the dark capture process in step S524, the systemcontrol circuit 50 updates Tn−1 by replacing it by Tn (Tn−1=Tn) so as tostore the currently used charge accumulation time Tn as Tn−1 indicatingthe previously used charge accumulation time (step S525), and sets andstores the dark capture flag in its internal memory or the memory 52(step S526).

The system control circuit 50 checks if the shutter switch SW2 is ON(step S527). If the shutter switch SW2 is OFF, the system controlcircuit 50 checks if the shutter switch SW1 is ON (step S528). If theshutter switch SW1 is ON, the flow returns to step S516 to repeat aseries of processes. On the other hand, if the shutter switch SW1 isturned off in step S528, the flow returns to step S502.

On the other hand, if it is determined in step S527 that the shutterswitch SW2 is turned on, the system control circuit 50 checks if an areathat can store sensed image data is available on an image storage bufferarea on the memory 30 (step S529). If no area that can store sensedimage data is available on the image storage buffer area on the memory30, a predetermined alert indication is made by means of an image orvoice using the indication unit 54 (step S530), and the flow thenreturns to step S502.

For example, the user experiences such state immediately after he or shehas executed continuous shot image sensing corresponding to a maximumnumber of images that can be stored in the image storage buffer area. Inthis state, the first image to be read out from the memory 30 andwritten in the recording medium 200 or 210 is not recorded on therecording medium 200 or 210 yet, and a free area even for one imagecannot be assured on the image storage buffer area on the memory 30.

When sensed image data is stored in the image storage buffer area on thememory 30 after it is compressed, it is checked in step S529 if an areathat can store sensed image data is available on the image storagebuffer area on the memory 30, in consideration of the fact that thecompressed image data size varies depending on the setups of thecompression mode.

If an area that can store sensed image data is available on the imagestorage buffer area on the memory 30, the system control circuit 50executes an image sensing process (step S531). More specifically, thesystem control circuit 50 reads out a sensed image signal, which hasbeen accumulated for a predetermined period of time upon image sensing,from the image sensing element 14, and writes the sensed image data onthe predetermined area of the memory 30 via the A/D converter 16, imageprocessing circuit 20, and memory control circuit 22, or from the A/Dconverter directly via the memory control circuit 22. The image sensingprocess is the same as that in the first embodiment.

Upon completion of the image sensing process, the system control circuit50 checks the state of the single/continuous shot flag stored in itsinternal memory or the memory 52 (step S532). As a result of checkingthe state of the single/continuous shot flag, if the single shot mode isselected, the system control circuit 50 executes a dark capture process(step S536).

In this manner, if it is determined in step S532 that the single shotmode is selected, the system control circuit 50 executes the darkcapture process after the image sensing process, so as to reduce therelease time lag upon depression of the shutter switch SW2.

On the other hand, as a result of checking the state of thesingle/continuous shot flag in step S532, if the continuous shot mode isselected, the system control circuit 50 checks the state of thecontinuous-shot start flag stored in its internal memory or the memory52 (step S533).

If the continuous-shot start flag is reset, the system control circuit50 sets the continuous-shot start flag (step S534).

In this manner, if the continuous-shot start flag is reset, since darkimage data required for the development process in step S538 has alreadybeen captured in the dark capture process in step S524, the second frameof continuous shot image sensing is sensed without executing the darkcapture process in step S536 after the first frame is sensed in stepS531 upon starting continuous shot image sensing.

With this control, the continuous shot frame interval between the firstand second frames upon continuous shot image sensing can be shortened,and the shutter release time lag for the second frame can be reduced.

On the other hand, if it is determined in step S533 that thecontinuous-shot start flag is set, the system control circuit 50 checksif the new charge accumulation time Tn that was determined in step S517and stored in its internal memory or the memory 52 is greater than theprevious charge accumulation time Tn−1 (step S535). If Tn≦Tn−1, the flowjumps to step S538.

That is, if the newly determined charge accumulation time Tn is equal toor shorter than the previously used charge accumulation time Tn−1, sincea dark image correction process can be done using the already captureddark image data in a development process in step S538, another darkcapture process in step S536 is skipped.

In this manner, if the continuous shot mode is set in step S532, and thesecond and subsequent frames of continuous shot image sensing are sensedwhile the shutter switch SW2 is held ON, the shutter release time lagfor the second and subsequent frames can be reduced unless the darkcapture process must be redone. On the other hand, if it is determinedin step S535 that Tn>Tn−1, i.e., if the newly determined chargeaccumulation time Tn is longer than the previously used chargeaccumulation time Tn−1, a new charge accumulation time Tn is set to redothe dark capture process in step S536.

That is, if the continuous shot mode is set in step S532, and the secondand subsequent frames of continuous shot image sensing are sensed whilethe shutter switch SW2 is held ON, the dark capture process is done instep S536 only when the dark capture process has already been done butmust be redone since it is determined that the image sensing conditionhas changed due to a change in charge accumulation time Tn.

In this way, when a constant exposure value of an object is maintainedduring continuous shot image sensing, the dark capture process need notbe redone during continuous shot image sensing, and nearly constantcontinuous shot frame intervals can be set.

In step S536, the system control circuit 50 executes the dark captureprocess for accumulating noise components such as dark current and thelike of the image sensing element 14 for the same period of time as thatrequired for actual image sensing, while closing the shutter 12, andreading out the accumulated noise image signal.

By making correction computations using dark image data captured by thedark capture process, sensed image data can be corrected for imagequality deterioration such as pixel omission or the like caused by darkcurrent noise produced by the image sensing element 14 and scratchesunique to the image sensing element 14. The dark capture process is thesame as that in the first embodiment.

Upon completion of the dark capture process, the system control circuit50 updates Tn−1 by replacing it by Tn (Tn−1=Tn) so as to store thecurrently used charge accumulation time Tn as Tn−1 indicating thepreviously used charge accumulation time (step S537).

The system control circuit 50 reads out some of image data written inthe predetermined area of the memory 30 via the memory control circuit22, executes a WB (white balance) integral computation process and OB(optical black) integral computation process required to executedevelopment processes, and stores the computation results in itsinternal memory or the memory 52.

The system control circuit 50 then reads out sensed image data writtenin the predetermined area of the memory 30 using the memory controlcircuit 22 and the image processing circuit 20 as needed, and executesvarious development processes including AWB (auto white balance)process, gamma conversion, color conversion, and the like using thecomputation results stored in its internal memory or the memory 52 (stepS538).

In the development processes in step S538, the system control circuit 50also executes a dark correction computation process for canceling darkcurrent noise and the like of the image sensing element 14 by executinga subtraction process using the dark image data captured in the darkcapture process.

The system control circuit 50 reads out image data written in thepredetermined area of the memory 30, makes the compression/expansioncircuit 32 execute an image compression process in accordance with theselected mode, and writes the image data that has sensed and undergone aseries of processes in a free image space of the image storage bufferarea on the memory 30 (step S539).

Upon executing a series of processes, the system control circuit 50starts a recording process for reading out image data stored in theimage storage buffer area of the memory 30, and writing the readoutimage data in the recording medium 200 or 210 such as a memory card,compact flash card, or the like (step S540).

This recording process is started for new image data, which has beensensed and undergone a series of processes, every time that image datais written in a free image space of the image storage buffer area on thememory 30.

While a write of image data in the recording medium 200 or 210 isunderway, a recording medium write access indication (e.g., flashing anLED of the indication unit 54) is made to clearly indicate that writeaccess.

The system control circuit 50 then checks if the shutter switch SW1 isON (step S541). If the shutter switch SW1 stays OFF, the flow returns tostep S502. If the shutter switch SW1 is ON, the system control circuit50 checks the state of the single/continuous shot flag stored in itsinternal memory or the memory 52 (step S542), and if the single shotmode is selected, the flow returns to step S541 to repeat the currentprocess until the shutter switch SW1 is turned off.

If the continuous shot mode is selected, the flow returns to step S516to proceed with image sensing, thus repeating a series of processes.

In the second embodiment, the predetermined charge accumulation time Tcpreferably uses, e.g., a charge accumulation time, which is used inimage sensing and the dark capture process at a shutter speed fasterthan 1/60 sec. In this case, the predetermined charge accumulation timeTc assumes an appropriate value beyond 17 msec, e.g., 20 msec, 30 msec,or the like.

The predetermined charge accumulation time Tc may be another arbitraryvalue, or may have not one value but a plurality of values in givenincrements, and appropriate one of these values may be selected incorrespondence with the operation mode or image sensing mode of theimage sensing apparatus 100.

The predetermined charge accumulation time Tc may be selected to be anappropriate value in accordance with the characteristics of the lensunit 300 attached. For example, since the camera-shake limit shutterspeed changes depending on the focal length and the presence/absence ofan anti-vibration function of the lens unit attached, the predeterminedcharge accumulation time Tc may be set accordingly.

In this manner, the predetermined charge accumulation time Tc may be setto be equal to or longer than a time corresponding to a shutter speedcapable of image sensing without causing any camera shake. Or thepredetermined charge accumulation time Tc may be set to be equal to orlonger than 1/60 sec. Furthermore, the predetermined charge accumulationtime Tc may be set to be equal to or longer than a time corresponding tothe shutter speed that can be synchronized with a flash.

In the above embodiments, the single or continuous shot mode is selectedusing the single/continuous shot switch 68. Alternatively, the single orcontinuous shot mode may be selected in correspondence with theoperation mode selected by the mode dial switch 60.

In the above embodiments, the charge accumulation time of the actualimage sensing process is set to be equal to that of the dark captureprocess. However, different charge accumulation times may be set as longas sufficient data that can be used to correct dark current noise andthe like can be obtained.

During execution of the dark capture process in step S122 or S134 orstep S524 or S536, since image sensing cannot be done, a visual or audiomessage indicating that the image sensing apparatus 100 is busy may beoutput using the indication unit 54 and/or image display unit 28.

In the above embodiments, image sensing is done by moving the mirror 130between the mirror up and down positions. However, the mirror 130 maycomprise a half mirror, and image sensing may be done without moving themirror.

Furthermore, the recording media 200 and 210 are not limited to memorycards such as PCMCIA cards, compact flash cards, or the like, harddisks, and the like, but may use micro DATs, magnetooptical disks,optical disks such as CD-Rs, CD-WRs, or the like, phase change opticaldisks such as DVDs, and the like. Also, the recording media 200 and 210may use hybrid media that integrate memory cards, hard disks, and thelike. Moreover, such hybrid media may include detachable media.

In the above embodiments, the recording media 200 and 210 areindependent from the image sensing apparatus 100 and are arbitrarilyconnectable. One or both the recording media 200 and 210 may bepermanently connected to the image sensing apparatus 100.

An arbitrary number (one or a plurality) of image recording media 200 or210 may be connectable to the image sensing apparatus 100.

In the above embodiments, the present invention is applied to anelectronic camera that senses still images, but may be applied to adigital video camera or the like that senses a moving image.

In the above embodiments, the charge accumulation time Tn is determinedafter completion of the distance measurement/photometry process, and thedark capture process is done. However, when the predetermined chargeaccumulation time Tc is used, since the control need not wait forsettlement of AE in the distance measurement/photometry process, thedark capture process may be started before completion of the distancemeasurement/photometry process. In this case, the AF and AE processoperations, and the dark capture process operation may be simultaneouslystarted, or the AF process operation and/or AE process operation may bestarted after the dark capture process operation is started.

Third Embodiment

FIG. 14 is a block diagram showing the arrangement of an electroniccamera according to the third embodiment of the present invention.

Referring to FIG. 14, the arrangement of the third embodiment comprisesan AF mode switch 69 in place of the single/continuous shot switch 68 inthe first embodiment.

The AF mode (setup) switch 69 can set one of a one-shot AF mode thatstarts AF operation after the shutter switch SW1 is turned on, andmaintains a focusing state once an in-focus is attained, and a servo AFmode that continues AF operation while the shutter switch SW1 is heldON.

Reference numeral 70 denotes a console, including various buttons, touchpanel, and the like, which include a single/continuous shot switch thatcan set one of a single shot mode for sensing one frame of image upondepression of the shutter switch SW2, and then setting a standby state,and a continuous shot mode for successively sensing images while theshutter switch SW2 is held ON, in addition to the operation members ofthe first embodiment.

The operation of the electronic camera with the arrangement of the thirdembodiment will be explained below.

FIGS. 15 and 16 are flow charts showing the image sensing operationprocess sequence of the image sensing apparatus 100. This processingprogram is stored in a storage medium such as the nonvolatile memory 56,is loaded onto the memory 52, and is executed by the CPU in the systemcontrol circuit 50.

Upon power ON after battery exchange or the like, the system controlcircuit 50 initializes flags, control variables, and the like and alsoperforms required predetermined initial setups in the respective unitsof the image sensing apparatus 100 (step S601). The system controlcircuit 50 checks the setup position of the power switch 72 to determineif the power switch 72 is set at the power-OFF position (step S602).

If the power switch 72 is set at the power-OFF position, the systemcontrol circuit 50 executes a predetermined end process (step S603).More specifically, the system control circuit 50 changes the indicationsof the respective indication units to an end state, records requiredparameters and setup values including flags, control variables, and thelike, and the currently selected mode in the nonvolatile memory 56, cutsoff unnecessary power supply to the respective units of the imagesensing apparatus 100 including the image display unit 28 by the powersupply control circuit 80, and so forth. After that, the flow returns tostep S602.

If the power switch 72 is set at the power-ON position, the systemcontrol circuit 50 checks using the power supply control circuit 80 ifthe remaining capacity and operation state of the power supply 86comprising batteries and the like pose any problem in the operation ofthe image sensing apparatus 100 (step S604). If any problem is found, apredetermined alert indication is made by means of an image or voiceusing the indication unit 54 (step S605), and the flow then returns tostep S602.

If no problem is found in the power supply 86, the system controlcircuit 50 checks the setup position of the mode dial switch 60 todetermine if the mode dial switch 60 is set at one of the image sensingmode positions (step S606). If the mode dial switch 60 is set at any ofother mode positions, the system control circuit 50 executes a processcorresponding to the selected mode (step S607), and the flow returns tostep S602 upon completion of the process.

On the other hand, if the mode dial switch 60 is set at one of the imagesensing mode positions, the system control circuit 50 checks if therecording medium 200 or 210 is attached, acquires management informationof image data recorded on the recording medium 200 or 210, and thenchecks if the operation state of the recording medium 200 or 210 posesany problem in the operation of the image sensing apparatus 100, inparticular, recording/playback of image data to/from the recordingmedium 200 or 210 (step S608). If any problem is found, a predeterminedalert indication is made by means of an image or voice using theindication unit 54 (step S605), and the flow then returns to step S602.

If no problem is found in step S608, the system control circuit 50checks the setup state of the AF mode setup switch 69 (step S609). Ifthe servo AF mode is selected, the circuit 50 sets an AF mode flag toindicate the servo AF mode (step S610); if the one-shot AF mode isselected, the circuit 50 sets the AF mode flag to indicate the one-shotAF mode (step S611).

The AF mode setup switch 69 can set one of a one-shot AF mode thatstarts AF operation after the shutter switch SW1 is turned on, andmaintains a focusing state once an in-focus is attained, and a servo AFmode that continues AF operation while the shutter switch SW1 is heldON. The state of the AF mode flag is stored in the internal memory ofthe system control circuit 50 or the memory 52.

The system control circuit 50 indicates various setup states of theimage display apparatus 100 by means of an image or voice using theindication unit 54 (step S612). When the image display of the imagedisplay unit 28 is ON, various setup states of the image displayapparatus 100 are indicated by means of an image also using the imagedisplay unit 28.

The system control circuit 50 checks if the shutter switch SW1 is ON(step S613). If the shutter switch SW1 is OFF, the flow returns to stepS602. On the other hand, if the shutter switch SW1 is ON, the systemcontrol circuit 50 executes a distance measurement/photometry process(step S614). More specifically, the system control circuit 50 executes adistance measurement process for bringing the photographing lens 310into focus on an object, and also executes a photometry process todetermine the aperture value and shutter speed. In the photometryprocess, the electronic flash is set if necessary. The details of thedistance measurement/photometry process are the same as those in theflow chart shown in FIG. 5.

The system control circuit 50 checks the state of the AF mode flagstored in its internal memory or the memory 52 (step S615). If the servoAF mode is selected, the flow advances to step S617 without executing adark capture process. With this control, the release time lag upondepression of the shutter switch SW2 in step S617 can be reduced.

On the other hand, if it is determined in step S615 that the one-shot AFmode is selected, the system control circuit 50 executes the darkcapture process for accumulating noise components such as dark currentand the like of the image sensing element 14 for the same period of timeas that required for actual image sensing, while closing the shutter 12,and reading out the accumulated noise image signal (step S616).

By making correction computations (dark current noise correctionprocess) using dark image data captured by the dark capture process,sensed image data can be corrected for image quality deterioration suchas pixel omission or the like caused by dark current noise produced bythe image sensing element 14 and scratches unique to the image sensingelement 14. The details of the dark capture process are the same asthose in the flow chart shown in FIG. 8.

In this manner, if it is determined in step S615 that the one-shot AFmode is selected, the dark capture process is done prior to continuousshot image sensing, thus setting nearly constant continuous shot frameintervals upon depression of the shutter switch SW2.

The system control circuit 50 checks if the shutter switch SW2 is ON(step S617). If the shutter switch SW2 is OFF, the system controlcircuit 50 checks if the shutter switch SW1 is turned off (step S618).

If the shutter switch SW1 is turned off, the flow returns to step S602.

On the other hand, if the shutter switch SW1 is ON, the system controlcircuit 50 checks the state of the AF mode flag stored in its internalmemory or the memory 52 (step S619). If the one-shot AF mode isselected, the flow returns to step S617. In this way, when the one-shotAF mode is set, the current process is repeated until the shutter switchSW1 is turned off, or until the shutter switch SW2 is turned on in stepS617.

On the other hand, if it is determined in step S619 that the servo AFmode is selected, the flow returns to step S614. In this manner, in theservo AF mode, the distance measurement/photometry process in step S614is repeated until the shutter switch SW1 is turned off, or until theshutter switch SW2 is turned on in step S617.

On the other hand, if it is determined in step S617 that the shutterswitch SW2 is turned on, the system control circuit 50 checks if an areathat can store sensed image data is available on an image storage bufferarea on the memory 30 (step S620). If no area that can store sensedimage data is available on the image storage buffer area on the memory30, a predetermined alert indication is made by means of an image orvoice using the indication unit 54 (step S621), and the flow thenreturns to step S602.

For example, the user experiences such state immediately after he or shehas executed continuous shot image sensing corresponding to a maximumnumber of images that can be stored in the image storage buffer area. Inthis state, the first image to be read out from the memory 30 andwritten in the recording medium 200 or 210 is not recorded on therecording medium 200 or 210 yet, and a free area even for one imagecannot be assured on the image storage buffer area on the memory 30.

When sensed image data is stored in the image storage buffer area on thememory 30 after it is compressed, it is checked in step S620 if an areathat can store sensed image data is available on the image storagebuffer area on the memory 30, in consideration of the fact that thecompressed image data size varies depending on the setups of thecompression mode.

If it is determined in step S620 that an area that can store sensedimage data is available on the image storage buffer area on the memory30, the system control circuit 50 executes an image sensing process(step S622). More specifically, the system control circuit 50 reads outa sensed image signal, which has been accumulated for a predeterminedperiod of time upon image sensing, from the image sensing element 14,and writes the sensed image data on the predetermined area of the memory30 via the A/D converter 16, image processing circuit 20, and memorycontrol circuit 22, or from the A/D converter directly via the memorycontrol circuit 22. The details of the image sensing process are thesame as those in the flow charts shown in FIGS. 6 and 7.

Upon completion of the image sensing process in step S622, the systemcontrol circuit 50 checks the state of the AF mode flag stored in itsinternal memory or the memory 52 (step S623). If the one-shot AF mode isselected, since the dark capture process has already been done in stepS616 prior to continuous shot image sensing, the system control circuit50 executes a development process in step S626. In this way, nearlyconstant continuous shot frame intervals can be set.

On the other hand, if the servo AF mode is selected, the system controlcircuit 50 checks if a setup time for charge accumulation in the darkcapture process must be newly set or changed (step S624). If the setuptime must be newly set or changed, the system control circuit 50executes a dark capture process (step S625).

For example, when continuous shot image sensing has started in the servoAF mode, a new dark capture process must be done immediately after thefirst frame has been sensed. For this purpose, a new setup time used instep S403 in the dark capture process in FIG. 8 is set.

On the other hand, during continuous shot image sensing in the servo AFmode, if the exposure (AE) result detected in the photometry process instep S206 shown in FIG. 5 has changed, and the shutter speed (Tv value)has changed accordingly, the setup time used in step S403 in the darkcapture process shown in FIG. 8 is changed as needed.

If it is determined in step S624 that a setup time need not be changed,the system control circuit 50 executes a development process in stepS626 without capturing new dark image data. In this case, thedevelopment process is executed using the already captured dark imagedata.

The system control circuit 50 executes the dark capture process foraccumulating noise components such as dark current and the like of theimage sensing element 14 for the same period of time as that requiredfor actual image sensing, while closing the shutter 12, and reading outthe accumulated noise image signal (step S625). By making correctioncomputations using dark image data captured by the dark capture process,sensed image data can be corrected for image quality deterioration suchas pixel omission or the like caused by dark current noise produced bythe image sensing element 14 and scratches unique to the image sensingelement 14.

If it is determined in step S623 that the servo AF mode is selected,since the dark capture process is done after the image sensing processin step S622, the release time lag upon depression of the shutter switchSW2 in step S617 can be reduced.

The system control circuit 50 reads out some of image data written inthe predetermined area of the memory 30 via the memory control circuit22, executes a WB (white balance) integral computation process and OB(optical black) integral computation process required to executedevelopment processes, and stores the computation results in itsinternal memory or the memory 52.

The system control circuit 50 then reads out sensed image data writtenin the predetermined area of the memory 30 using the memory controlcircuit 22 and the image processing circuit 20 as needed, and executesvarious development processes including AWB (auto white balance)process, gamma conversion, color conversion, and the like using thecomputation results stored in its internal memory or the memory 52 (stepS626).

In the development processes, the system control circuit 50 alsoexecutes a dark correction computation process for canceling darkcurrent noise and the like of the image sensing element 14 by executinga subtraction process using the dark image data captured in the darkcapture process.

The system control circuit 50 reads out image data written in thepredetermined area of the memory 30, makes the compression/expansioncircuit 32 execute an image compression process in accordance with theselected mode, and writes the image data that has sensed and undergone aseries of processes in a free image space of the image storage bufferarea on the memory 30 (step S627).

The system control circuit 50 then starts a recording process forreading out image data stored in the image storage buffer area of thememory 30, and writing the readout image data in the recording medium200 or 210 such as a memory card, compact flash card, or the like (stepS628). This recording process is started for new image data, which hasbeen sensed and undergone a series of processes, every time that imagedata is written in a free image space of the image storage buffer areaon the memory 30.

While a write of image data in the recording medium 200 or 210 isunderway, a recording medium write access indication (e.g., flashing anLED of the indication unit 54) is made to clearly indicate that writeaccess.

The system control circuit 50 then checks if the shutter switch SW1 isON (step S629). If the shutter switch SW1 stays OFF, the flow returns tostep S602. If the shutter switch SW1 is ON, the system control circuit50 checks the state of the AF mode flag stored in its internal memory orthe memory 52 (step S630), and if the servo AF mode is selected, theflow returns to step S614 to sense the next image so as to proceed withimage sensing while continuously executing AF and AE. On the other hand,if the one-shot AF mode is selected, the flow returns to step S617 tosense the next image, so as to proceed with image sensing withoutexecuting new AF and AE.

FIG. 17 is a timing chart showing the flow of the image sensingoperation of the third embodiment. As has already been described indetail above using FIGS. 5 to 8 and FIGS. 15 and 16, the servo AF moderepeats operations for repeating the AF and AE operations upondepression of the shutter switch SW1, and executing dark capture upondepression of the shutter switch SW2 after image sensing while theshutter switch SW2 is held down. On the other hand, in the one-shot AFmode, the AF and AE operations and the dark capture process are doneupon depression of the shutter switch SW1, and images are successivelysensed upon depression of the shutter switch SW2, while the shutterswitch SW2 is held down.

In this embodiment, the AF mode setup switch 69 is used to switch the AFmode between the one-shot AF mode and servo AF mode. Alternatively, oneof the one-shot AF mode and servo AF mode may be selected in accordancewith the operation mode selected by the mode dial switch 60.

In the above embodiment, the charge accumulation time of the actualimage sensing process is set to be equal to that of the dark captureprocess. However, different charge accumulation times may be set as longas sufficient data that can be used to correct dark current noise andthe like can be obtained.

Furthermore, during execution of the dark capture process in step S616or S625, since image sensing cannot be done, a visual or audio messageindicating that the image sensing apparatus 100 is busy may be outputusing the indication unit 54 and/or image display unit 28.

In the above embodiment, image sensing is done by moving the mirror 130between the mirror up and down positions. However, the mirror 130 maycomprise a half mirror, and image sensing may be done without moving themirror.

Furthermore, the recording media 200 and 210 are not limited to memorycards such as PCMCIA cards, compact flash cards, or the like, harddisks, and the like, but may use micro DATs, magnetooptical disks,optical disks such as CD-Rs, CD-WRs, or the like, phase change opticaldisks such as DVDs, and the like. Also, the recording media 200 and 210may use hybrid media that integrate memory cards, hard disks, and thelike. Moreover, such hybrid media may include detachable media.

In the above embodiment, the recording media 200 and 210 are independentfrom the image sensing apparatus 100 and are arbitrarily connectable.One or both the recording media 200 and 210 may be permanently connectedto the image sensing apparatus 100.

An arbitrary number (one or a plurality) of image recording media 200 or210 may be connectable to the image sensing apparatus 100.

In the above embodiment, the present invention is applied to anelectronic camera that senses still images, but may be applied to adigital video camera or the like that senses a moving image.

Moreover, the present invention may be applied to either a systemconstituted by a plurality of devices, or an apparatus consisting of asingle equipment. Also, the present invention may be applied to a casewherein the invention is achieved by supplying a program to a system orapparatus. In this case, by loading the contents of a storage mediumthat stores a program represented by software for implementing thepresent invention onto the system or apparatus, that system or apparatuscan enjoy the effects of the present invention.

FIG. 18 shows the memory map of the nonvolatile memory 56 as a storagemedium. The nonvolatile memory 56 comprising an EEPROM stores a mainimage sensing operation process program module shown in the flow chartsin FIGS. 2, 3, and 4, a distance measurement/photometry process programmodule shown in the flow chart in FIG. 5, an image sensing processprogram module shown in the flow charts in FIGS. 6 and 7, a dark captureprocess program module shown in the flow chart in FIG. 8, a main imagesensing operation process program module shown in the flow charts inFIGS. 10, 11, 12, and 13, and the like.

FIG. 19 shows the memory map of the nonvolatile memory 56 as a storagemedium. The nonvolatile memory 56 comprising an EEPROM stores a mainimage sensing operation process program module shown in the flow chartsin FIGS. 15 and 16, a distance measurement/photometry process programmodule shown in the flow chart in FIG. 5, an image sensing processprogram module shown in the flow charts in FIGS. 6 and 7, a dark captureprocess program module shown in the flow chart in FIG. 8, and the like.

The storage medium that supplies program modules is not limited to theROM. For example, a floppy disk, hard disk, optical disk, magnetoopticaldisk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, and thelike may be used.

Furthermore, the functions of the above-mentioned embodiments may beimplemented by some or all of actual processing operations executed by aCPU or the like arranged in a function extension board or a functionextension unit, which is inserted in or connected to the computer, afterthe program code read out from the storage medium is written in a memoryof the extension board or unit.

The embodiments of the present invention have been described. However,the present invention is not limited to the arrangements of suchembodiments, but may be applied to any other arrangements as long asthey may achieve functions defined in the appended claims or functionsof the arrangements of the embodiments.

For example, in each of the above embodiments, dark image data iscaptured before image sensing in the continuous shot mode. However, thepresent invention can be applied even when dark image data is capturedafter image sensing.

In each of the above embodiments, whether or not dark image data iscaptured is determined in the continuous shot mode or servo AF mode.However, the present invention can be applied even when suchdetermination is made at any other timings, e.g., the single shot mode,one-shot AF mode, and the like.

The present invention is not limited to determination as to whether ornot dark image data is captured in each of the above embodiments. Forexample, dark image data may be captured every time the image sensingtime for capturing dark image data has changed.

The software and hardware arrangements of the above embodiments can beappropriately replaced.

The present invention may be achieved by combining the above embodimentsor their technical components as needed.

The present invention may be applied even when all or some of claims orthe arrangements of the embodiments form a single apparatus, arecombined with another apparatus, or are building components of theapparatus.

The present invention can be applied to various types of cameras such asan electronic still camera, video movie camera, a camera using a silverhalide film, and the like, image sensing apparatuses other than cameras,devices applied to such cameras and image sensing apparatuses, andbuilding components of those devices.

As many apparently widely different embodiments of the present inventioncan be made without departing from the spirit and scope thereof, it isto be understood that the invention is not limited to the specificembodiments thereof except as defined in the appended claims.

1. An apparatus comprising: (A) an image sensing device; and (B) a signal processing device which performs a first image sensing operation for making said image sensing device perform an image sensing operation in an exposure state to obtain a sensed image signal, and a second image sensing operation for making said image sensing device perform an image sensing operation in a non-exposure state to obtain a sensed image signal, and processing the sensed image signal obtained by the first image sensing operation by the sensed image signal obtained by the second image sensing operation, wherein said signal processing device performs the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is longer than a predetermined charge accumulation time and does not perform the second image sensing operation if it is not determined that the charge accumulation time of the first image sensing operation is longer than the predetermined charge accumulation time.
 2. An apparatus comprising: (A) an image sensing device; and (B) a signal processing device which performs a first image sensing operation for making said image sensing device perform an image sensing operation in an exposure state to obtain a sensed image signal, and a second image sensing operation for making said image sensing device perform an image sensing operation in a non-exposure state to obtain a sensed image signal, and processing the sensed image signal obtained by the first image sensing operation by the sensed image signal obtained by the second image sensing operation, wherein said signal processing device does not perform the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is shorter than a predetermined charge accumulation time and perform the second image sensing operation if it is not determined that the charge accumulation time of the first image sensing operation is shorter than the predetermined charge accumulation time.
 3. An apparatus comprising: (A) an image sensing device; and (B) a signal processing device which performs a first image sensing operation for making said image sensing device perform an image sensing operation in an exposure state to obtain a sensed image signal, and a second image sensing operation for making said image sensing device perform an image sensing operation in a non-exposure state to obtain a sensed image signal, and processing the sensed image signal obtained by the first image sensing operation by the sensed image signal obtained by the second image sensing operation, wherein said signal processing device performs the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is longer than a predetermined charge accumulation time and does not perform the second image sensing operation if it is determined that the charge accumulation time of the first image sensing operation is shorter than the predetermined charge accumulation time.
 4. An apparatus comprising: (A) an image sensing device; (B) an operating device which is operable by an operator and sets the apparatus to a first operation state or a second operation state different from the first operation; and (C) a signal processing device which performs a first image sensing operation for making said image sensing device perform an image sensing operation in an exposure state to obtain a sensed image signal, and a second image sensing operation for making said image sensing device perform an image sensing operation in a non-exposure state to obtain a sensed image signal, and processing the sensed image signal obtained by the first image sensing operation by the sensed image signal obtained by the second image sensing operation, wherein when the first operation state is set, said signal processing device performs the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is longer than a first charge accumulation time and does not perform the second image sensing operation if it is not determined that the charge accumulation time of the first image sensing operation is longer than the first charge accumulation time, and when the second operation state is set, said signal processing device performs the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is longer than a second charge accumulation time and does not perform the second image sensing operation if it is not determined that the charge accumulation time of the first image sensing operation is longer than the second charge accumulation time, the first charge accumulation time being different from the second charge accumulation time.
 5. An apparatus comprising: (A) an image sensing device; (B) an operating device which is operable by an operator and sets the apparatus to a first operation state or a second operation state different from the first operation; and (C) a signal processing device which performs a first image sensing operation for making said image sensing device perform an image sensing operation in an exposure state to obtain a sensed image signal, and a second image sensing operation for making said image sensing device perform an image sensing operation in a non-exposure state to obtain a sensed image signal, and processing the sensed image signal obtained by the first image sensing operation by the sensed image signal obtained by the second image sensing operation, wherein when the first operation state is set, said signal processing device does not perform the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is shorter than a first charge accumulation time and perform the second image sensing operation if it is not determined that the charge accumulation time of the first image sensing operation is shorter than the first charge accumulation time, and when the second operation state is set, said signal processing device does not perform the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is shorter than a second charge accumulation time and perform the second image sensing operation if it is not determined that the charge accumulation time of the first image sensing operation is shorter than the second charge accumulation time, the first charge accumulation time being different from the second charge accumulation time.
 6. An apparatus comprising: (A) an image sensing device; (B) an operating device which is operable by an operator and sets the apparatus to a first operation state or a second operation state different from the first operation; and (C) a signal processing device which performs a first image sensing operation for making said image sensing device perform an image sensing operation in an exposure state to obtain a sensed image signal, and a second image sensing operation for making said image sensing device perform an image sensing operation in a non-exposure state to obtain a sensed image signal, and processing the sensed image signal obtained by the first image sensing operation by the sensed image signal obtained by the second image sensing operation, wherein when the first operation state is set, said signal processing device performs the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is longer than a first charge accumulation time and does not perform the second image sensing operation if it is determined that the charge accumulation time of the first image sensing operation is shorter than the first charge accumulation time and, when the second operation state is set, said signal processing device performs the second image sensing operation if it is determined that a charge accumulation time of the first image sensing operation is longer than a second charge accumulation time and does not perform the second image sensing operation if it is determined that the charge accumulation time of the first image sensing operation is shorter than the second charge accumulation time, the first charge accumulation time being different from the second charge accumulation time. 